SA-JSTN: Self-Attention Joint Spatiotemporal Network for Temperature Forecasting
نویسندگان
چکیده
The rapid development of remote sensing technology has brought abundant data support for deep learning based temperature forecasting research. However, recently proposed methods usually focus on the temporal relationship among observation information, whereas ignore spatial positions different regions. Motivated by that adjacent regions present similar trends, in this paper we consider as a spatiotemporal sequence prediction problem, and propose new model forecasting, Self-Attention Joint Spatiotemporal Network (SA-JSTN), which simultaneously captures interdependency information. kernel component SA-JSTN is newly developed Memory (STM) unit, describes models via unified memory cell. STM constructed units convolutional LSTM (ConvLSTM). Instead using simple convolutions information extraction, improve ConvLSTM self-attention module, significantly enhanced global representation ability our network. Compared with other methods, able to integrate correlation into series thus better performance especially short-term prediction. We have conducted comparison experiments two typical sets validate effectiveness method.
منابع مشابه
Joint Network based Attention for Action Recognition
By extracting spatial and temporal characteristics in one network, the two-stream ConvNets can achieve the state-ofthe-art performance in action recognition. However, such a framework typically suffers from the separately processing of spatial and temporal information between the two standalone streams and is hard to capture long-term temporal dependence of an action. More importantly, it is in...
متن کاملRecurrent Mixture Density Network for Spatiotemporal Visual Attention
In many computer vision tasks, the relevant information to solve the problem at hand is mixed with irrelevant, distracting information. This has motivated researchers to design attentional models that can dynamically focus on parts of images or videos that are salient, e.g., by down-weighting irrelevant pixels. In this work, we propose a spatiotemporal attentional model that learns where to loo...
متن کاملElectrophysiological Evidence for Spatiotemporal Flexibility in the Ventrolateral Attention Network
Successful completion of many everyday tasks depends on interactions between voluntary attention, which acts to maintain current goals, and reflexive attention, which enables responding to unexpected events by interrupting the current focus of attention. Past studies, which have mostly examined each attentional mechanism in isolation, indicate that volitional and reflexive orienting depend on t...
متن کاملSelf-Organized-Expert Modular Network for Classification of Spatiotemporal Sequences
We investigate a form of modular neural network for classification with (a) pre-separated input vectors entering its specialist (expert) networks, (b) specialist networks which are selforganized (radial-basis function or self-targeted feedforward type) and (c) which fuses (or integrates) the specialists with a single-layer net. When the modular architecture is applied to spatiotemporal sequence...
متن کاملFog Forecasting Using Self Growing Neural Network
This paper proposes a method to solve problem that comes with imbalanced training sets which is often seen in the practical applications. We modi ed Self Growing Neural Network CombNET-II to deal with the imbalanced condition. This model is then applied to practical application which was launched in '99 Fog Forecasting Contest sponsored by Neurocomputing Technical Group of IEICE, Japan. In this...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
سال: 2021
ISSN: ['2151-1535', '1939-1404']
DOI: https://doi.org/10.1109/jstars.2021.3112131